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DETAILED ACTION 

Applicant's arguments, filed 7/6/2010, have been fully considered. The following 
rejections and/or objections are either reiterated or newly applied. They constitute the 
complete set presently being applied to the instant application. 

Applicants have amended their claims, filed 7/6/2010, and therefore rejections 
newly made in the instant office action have been necessitated by amendment. 

Claims 19-29 are withdrawn from further consideration pursuant to 37 CFR 
1 .142(b) as being drawn to a nonelected inventive group, there being no allowable 
generic or linking claim. Election was made without traverse in the reply filed on 
4/20/2006. 

Claims 1-18 and 30-36 are the current claims hereby under examination. 
Drawings 

The objection to the drawings has been withdrawn. 



Claim Rejections - 35 USC §103 -Maintained 

The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

Claims 1-2, 4-6, 8-9, 11, 13-17, and 30-36 are rejected under 35 U.S.C. 103(a) 

as being unpatentable over Gleason et al. (US P/N 6,456,899). 

The claims are directed to a method of image analysis comprising: 

a) receiving a first image at a processor; 

b) transforming the first image into a feature space; 

c) selecting at least one region of interest (ROI) at a pixel level of 

processing; 

d) extracting two or more features from the ROI at a pixel level of 

processing; 

e) selecting at least one non-ROI at a pixel level of processing; 

f) extracting two or more features from the non-ROI at a pixel level of 

processing; 

g) ranking, in a combinatorial manner, the extracted features from the ROI 
and non-ROI based on feature performance for successful detection of a selected ROI 
at a pixel level of processing; 

h) recording the ranked extracted features; 
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i) selecting a classification algorithm; 

j) running the classification algorithm to classify the first image or a second 
image into one or more ROIs at a pixel level of processing, wherein the first or second 
image selected for classification is a classified image; 

k) recording one or more of the ROIs based on pixel level processing; and 

I) outputting analysis results to a computing device. 
Gleason et al. teach limitations of claim 1 as follows: Gleason et al. at col. 1 , 
lines 14-16 and col. 2 lines 50-63 describe a computer system for performing the taught 
invention and capturing a reference image, which reads on step a). Gleason et al. at 
col. 3, lines 28-42 teach wherein a reference image is transformed into pixel values and 
segmented into different regions, which reads on step b) transforming the image into a 
feature space. Gleason et al. at col. 3, lines 54-67 and col. 4, lines 1-3 teach wherein 
the image analysis system extracts features from each of the segmented regions at a 
time. Therefore, the system upon extracting features from one particular segmented 
region at a particular time reads on steps c) and d) of selecting a ROI and extracting 
features from that ROI. Furthermore, the particular selection of a segmented region, 
i.e. ROI, then implicitly at the same time, is selecting the other segmented regions as 
non-ROIs. Because Gleason et al. teach that the other segmented regions also have 
their features extracted, this further reads on steps e) and f). Gleason et al. at col. 4, 
lines 4-19 teach that the extracted features are then pared down into a meaningful, i.e. 
useful, subset of discriminatory features, which reads on step g). Gleason et al. teach 
at col. 4, lines 20-25 classifying each segmented region/image, i.e. ROIs and non-ROIs, 
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based on the ranked extracted features. Gleason et al. further teach at col. 9, lines 33- 
35 that any classification algorithm may be used as it long as it follows the proper 
processing steps. Thus the use of a particular classifier out of the option of using any 
classifier reads on steps i) and j) of selecting and running a classifier. Gleason et al. 
teach at col. 3, lines 60-64, that the extracted features characteristic for each of the 
regions is recorded in a table, which reads on step k). Gleason et al. teach at col. 1 , 
lines 13-16, using a computer system for performing the image analysis method, 
wherein it is inherent that analysis results are output to a computing device, i.e. 
computer system, which reads on step I). 

Gleason et al. suggest, but do not explicitly teach recording the ranked extracted 
features as in step h). 

Gleason et al. suggest this because they teach at col. 4, lines 4-6, that the 
extracted features, prior to being ranked, are in a table, which inherently means that the 
features prior to ranking have been recorded. Furthermore, Gleason et al. at col. 4, 
lines 20-25 teach further use of the ranked features in a step for classification. 

It would have been obvious to one of ordinary skill in the art at the time of the 
instant invention to have ranked the extracted features as taught by Gleason et al. and 
then recorded the ranked extracted features. This is because Gleason et al. at col. 4, 
lines 20-25 teach further use of the ranked extracted features, i.e. the discriminatory 
features, in a classification method. In addition, Gleason et al. further at col. 4, lines 
27-34 teach using historical information to further classify the invention thus obviating 
the recordation of measured data. Thus one of ordinary skill in the art would have 
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recognized that recording measured data was part of the routine of a skilled practitioner 
and would have yielded predictable results. 

Gleason et al. teach at col. 3, lines 35-38 teach using pixels of each of the 
segmented regions of the reference image in the analysis method, which reads on claim 
2. 

Gleason et al. suggest, but do not explicitly teach selecting a second level of 
processing wherein the second level is subimage processing as in claims 4-5 or object 
processing as in claim 8. 

Gleason et al. suggest this because applicant has defined sub-image processing 
at paragraph [0060] of the published application as "a second level of abstraction that 
utilizes attributes, such as texture-related information" and wherein object level process 
extracts features at the object level such as texture information. Thus using texture 
information in the method of performing image analysis reads on subimage and object 
level processing as claimed. Gleason et al. at col. 3, lines 57-61 , teach during the 
feature extraction step of each of the segmented regions in the image analysis taught, 
that the extractor can measure characteristics, such as texture and color. Therefore, 
using characteristics such as texture reads on subimage and object processing. 

It would have been obvious to one of ordinary skill in the art at the time of the 
instant invention to have used in the image analysis method taught by Gleason et al., a 
step of subimage level of processing. This is because Gleason et al. at col. 3, lines 57- 
61 , teach processing texture characteristics in the image analysis. Thus, Gleason et al. 
teach that subimage level processing, i.e. processing texture-related information, has 
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been incorporated in the taught image analysis method. One of ordinary skill in the art 
at the time of the instant invention would have been motivated to further perform the 
subimage level processing in the method taught by Gleason et al. in order to exploit the 
level of information available at the variable-size image levels in order to classify the 
different regions appropriately or more accurately. One of skill in the art would want to 
ensure the highest level of accuracy when analyzing and classifying semiconductor 
images for appropriate defects as to provide a high level of efficiency. Moreover, one of 
ordinary skill in the art would have recognized that applying the known technique would 
have yielded these predictable results. 

Gleason et al. teach as described above and further at col. 4, lines 59-67 and col. 
5, the steps of extracting features, ranking the extracted features, and classifying the 
image as in limitations of claim 6. 

Gleason et al. suggest, but do not explicitly teach the step of selecting at least 
one polygonal ROI from the classified image at a subimage level of processing with 
regards to limitations of claims 6 and 9. 

Gleason et al. suggest this because they teach at col 4, lines 59-63 performing 
image analysis comprising steps of extracting features for classification on an image 
where a user wants to measure features, such as textures, i.e. subimage features. 
Thus Gleason et al. teach performing the subimage analysis on user designated areas. 

It would have been obvious to one of ordinary skill in the art at the time of the 
instant invention to have selected polygonal ROIs and polygonal non-ROIs in the 
method of image analysis as taught by Gleason et al. This is because Gleason et al. 
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teach at col 4, lines 59-63 performing image analysis comprising steps of extracting 
features for classification in a user designated area to measure features, such as 
textures, i.e. subimage features. The image processing is performed as described 
above, but with reference to user designated suspect areas. Thus Gleason et al. teach 
that the method of selecting an area for subimage processing is a known technique. 
The process of selecting a polygonal ROI and polygonal non-ROI for image processing 
is an obvious variation of the known method of selecting an area for image processing. 
Therefore, one of ordinary skill in the art would have recognized that applying the known 
technique would have yielded predictable results. 

In addition, Gleason et al. suggest, but do not explicitly teach recording the 
ranked extracted features as in a limitation step of claim 6 or recording at least one 
polygonal ROI at an object level of processing as in a limitation step of claim 10. 

Gleason et al. suggest this because they teach at col. 4, lines 4-6, that the 
extracted features, prior to being ranked, are in a table, which inherently means that the 
features prior to ranking have been recorded. Furthermore, Gleason et al. at col. 4, 
lines 20-34 teach further use of historical data and the ranked features in a step for 
classification. Additionally, Gleason et al. at col. 6, lines 38-57 teach storing classified 
data in a database. 

It would have been obvious to one of ordinary skill in the art at the time of the 
instant invention to have ranked the extracted features as taught by Gleason et al. and 
then recorded the ranked extracted features and classified segments or classified areas 
designated by a user for analyzing. This is because Gleason et al. at col. 4, lines 20-25 
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teach further use of the ranked extracted features, i.e. the discriminatory features, in a 
classification method. In addition, Gleason et al. further at col. 4, lines 27-34 teach 
using historical information to further classify the invention thus obviating the 
recordation of measured data. Furthermore, Gleason et al. at col. 6, lines 38-57 teach 
storing classified data in a database. Thus one of ordinary skill in the art would have 
recognized that recording measured and/or classified data was part of the routine of a 
skilled practitioner and would have yielded predictable results. 

Gleason et al. teach as described above and further at col. 4, lines 59-67 and col. 
5, the steps of extracting features, ranking the extracted features, and classifying the 
image as in limitations of claim 1 1 . 

Gleason et al. do not explicitly teach selecting a third level processing wherein 
the processing is object processing as in claims 13-14. 

It would have been obvious to one of ordinary skill in the art at the time of the 
instant invention to have selected a third level, object level, processing in the method of 
performing image analysis as taught by Gleason et al. This is because the method is 
directed towards image analysis for detecting defected semiconductor wafers. One of 
skill in the art would have been motivated to have performed a third, i.e. object, level of 
processing on the image data to ensure a more accurate detection of defected 
semiconductor wafers. Furthermore, Gleason et al. teach the method of image 
analysis being able to be performed at the object level as described above. Therefore, 
one of ordinary skill in the art would have recognized that applying the taught object 
level of processing as a third level of processing in the method of image analysis would 
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have been predictable and resulted in an improved method, i.e. a more accurate 
classification of a defect image. 

Gleason et al. teach the limitations of claims 15-17 with respect to the steps and 
limitations for claims 1-14 as described above. 

Gleason et al. do not explicitly teach performing the further image analysis steps 
either before or after outputting analysis results as in claims 30-35. 

It would have been obvious to one of ordinary skill in the art at the time of the 
instant invention to have performed the further image analysis steps both, before and 
after, outputting the analysis results in the image analysis method taught by Gleason et 
al. This is because the outputting analysis step in each of the claims refers to a step of 
outputting an analysis result to a computing device. Gleason et al. teach at col. 1 , 
performing the method of image analysis in a computer system. Thus, the steps of 
further performing image analysis both before and after outputting analysis results to 
computing device as recited in claims 30-35 will have been performed in the computer 
system. Therefore, it would have been obvious to one of ordinary skill in the art that 
using the same computer system for performing the further steps of image analysis 
either before or after outputting analysis results to the computer, i.e. computing device, 
because the outputting step to the same computer will not have affected the image 
analysis method. In other words, with regards to image processing, the step of 
outputting analysis results to a computing device, if happening inside the same 
computer system, will be a step that necessarily happens with regards to the image 
processing being performed inside the computer system. Thus the differences 
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between the prior art and the claimed invention were encompassed in known variations 
or in a principal known in the prior art. 

Gleason et al. at col. 4, lines 4-1 9 teach a step wherein the table of each of the 
features from the ROI and non-ROI are pared down into a meaningful subset of 
discriminatory features, wherein these features have discriminatory power, i.e. can be 
used for the ability to detect an ROI, which reads on claim 36. 

Response to Arguments 

Applicant's arguments filed 7/6/2010 have been fully considered but they are not 
persuasive. 

Applicant at page 12 of the remarks argues that Gleason does not disclose or 
even suggest selecting at least one ROI and at least one non-ROI from a first image at 
a pixel level of processing. Applicant argues that Gleason describes comparing an 
image of a region in a reference semiconductor chip with an image of an identical region 
in a second semiconductor chip to determine whether the second semiconductor chip 
has any defects. 

Applicant's arguments are not found persuasive because Gleason at Col. 3 
teaches that the reference image is segmented or divided into different regions and 
results into a segmented reference image. Thus one image is divided into different 
regions. Gleason at col. 4 describes that the segmented reference image is used as a 
map to decide where to go in the reference image to make its measurements. 
Therefore, the segmentation of one image into different regions, reads on the selection 
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of an ROI and a non-ROI. Although the instantly claimed method refers to two different 
selected regions, one as an ROI and one as a non-ROI, they are broadly and 
reasonably interpreted as reading on an image segmented into different regions. 

Applicant further argues that Gleason does not describe ranking in a 
combinatorial manner the extracted features from the ROI and non-ROI based on 
feature performance for successful detection. 

Applicant's arguments are not found persuasive because Gleason at col. 3, Ines 
52-67 through col. 4, lines 3-19 describe wherein a layer feature extractor measures 
features about each of the segmented regions using the segmented image as a map as 
to where to go. Then the layer feature selector pares down the table of features into a 
meaningful, i.e. useful, subset of discriminatory features, i.e. ranks the extracted 
features in a combinatorial manner. 



Claims 3, 7, 10, 12, 18 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Gleason et al. (US P/N 6,456,899) as applied to claims 1-2, 4-6, 8-9, 
the step limitation of recording at least one polygonal ROI at an object level of 
processing in claim 10, 11, 13-17, and 30-36 and further in view of Levenson et al. (US 
P/N 6, 750, 964). 

Gleason et al. teach claims 1-2, 4-9, the step limitation of recording at least one 
polygonal ROI at an object level of processing in claim 10, and 11-17 as discussed 
above in the instant Office Action. 
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Gleason et al. do not explicitly teach a method of transmitting the recorded ROIs 
at a pixel, subimage, and object level of processing for laser capture microdissection as 
in limitations of claims 3, 7, 10, 12, and 18. 

Levenson et al. at col. 2, lines 45-61 teaches a method of laser capture 
microdissection after target image analysis. 

It would have been obvious to one of ordinary skill in the art at the time of the 
instant invention to have used a method of image analysis as taught by Gleason et al. 
for use in a method for laser capture microdissection as taught by Levenson et al. This 
is because the image analysis method taught by Gleason et al. was one wherein the 
goal was to classify different regions of an image. The use of image analysis for 
classifying images is a known technique recognized as part of the ordinary capabilities 
of one skilled in the art and applied to many different fields. Therefore, one of ordinary 
skill in the art could have applied the taught method of image analysis for classifying 
regions of an image in the same way and applied it to classifying regions of a target 
image in the method taught by Levenson, wherein the results would have been 
predictable, i.e. usable for laser capture microdissection. 
Response to Arguments 

Applicant's arguments filed 7/6/2010 have been fully considered but they are not 
persuasive. 

Applicant further argues that like Gleason, Levenson does not disclose or even 
suggest all the elements of claim 1 . 
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Applicant's arguments are not found persuasive for the reasons stated above in 
the instant Office Action. 

Conclusion 

No claim is allowed. 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Jason Sims, whose telephone number is (571)-272- 
7540. 

If attempts to reach the Examiner by telephone are unsuccessful, the Examiner's 
supervisor, Marjorie Moran can be reached via telephone (571)-272-0720. 

Papers related to this application may be submitted to Technical Center 1600 by 
facsimile transmission. Papers should be faxed to Technical Center 1600 via the 
Central PTO Fax Center. The faxing of such papers must conform with the notices 
published in the Official Gazette, 1096 OG 30 (November 15, 1988), 1156 OG 61 
(November 1 6, 1 993), and 1 1 57 OG 94 (December 28, 1 993) (See 37 CFR § 1 .6(d)). 
The Central PTO Fax Center number is (571)-273-8300. 
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